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What is The Nation’s Report Card™? 



The Nations Report Card™, the National Assessment of 
Educational Progress (NAEP), is a nationally representative 
and continuing assessment of what Americas students know 
and can do in various subject areas. For over three decades, 
assessments have been conducted periodically in reading, 
mathematics, science, writing, history, geography, and other 
subjects. 

By making objective information on student performance 
available to policymakers at the national, state, and local 
levels, NAEP is an integral part of our nations evaluation 
of the condition and progress of education. Only informa- 
tion related to academic achievement and relevant variables 
is collected under this program. The privacy of individual 
students and their families is protected, and the identities of 
participating schools are not released. 

NAEP is a congressionally mandated project of the 
National Center for Education Statistics within the 
Institute of Education Sciences of the U.S. Department 



of Education. The Commissioner of Education Statistics 
is responsible, by law, for carrying out the NAEP project 
through competitive awards to qualified organizations. 

In 1988, Congress established the National Assessment 
Governing Board (NAGB) to oversee and set policy for 
NAEP. The Board is responsible for selecting the subject 
areas to be assessed; setting appropriate student achieve- 
ment levels; developing assessment objectives and test 
specifications; developing a process for the review of the 
assessment; designing the assessment methodology; devel- 
oping guidelines for reporting and disseminating NAEP 
results; developing standards and procedures for inter- 
state, regional, and national comparisons; determining 
the appropriateness of all assessment items and ensuring 
the assessment items are free from bias and are secular, 
neutral, and nonideological; taking actions to improve the 
form, content, use, and reporting of results of the National 
Assessment; and planning and executing the initial public 
release of NAEP reports. 
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Executive Summary 

This report is the first to focus on private school stu- 
dents’ performance on NAEP assessments. It provides 
results in reading, mathematics, science, and writing 
in 2000, 2002, 2003, and 2005. Specifically, it focuses 
on the three private school types that combined enroll 
the greatest proportion of private school students 
(Catholic, Lutheran, and Conservative Christian) as 
well as private schools overall. It also compares the per- 
formance of students in these schools to that of public 
school students to provide additional perspective. 

Comparing student 
performance among 
the three types of pri- 
vate schools highlights 
several differences at 
grades 4 and 8 and 
a few at grade 12. 

Among the three types 
of private schools, few 
significant differences 
in performance were 
found at grade 12. The exceptions were that in 2000, 
the average score in science for grade 12 students in 
Catholic schools was 6 points higher than for students 
in Lutheran schools, and that in the 2000 mathemat- 
ics assessment, a higher percentage of twelfth-graders 
in Catholic schools performed at or above Proficient 
than twelfth-graders in Conservative Christian schools. 
Where differences existed at grades 4 and 8, students 
in Lutheran schools generally outperformed those in 
Conservative Christian schools. In some grade/subject 



combinations, Lutheran school students outperformed 
Catholic school students, and Catholic school students 
outperformed Conservative Christian school students. 

Students at grades 4, 8, and 12 in all categories of 
private schools had higher average scores in reading, 
mathematics, science, and writing than their counter- 
parts in public schools. In addition, higher percentages 
of students in private schools performed at or above 
Proficient compared to those in public schools. 

Average scores in mathematics at grades 4 and 8 
increased between 2000 and 2003 for both public and 
private schools overall. Students in Catholic schools also 
had higher average mathematics scores in 2003 than in 
2000 in both grades. 

The three types of private schools have few differences 
in their student demographics, except that Catholic 
schools generally enroll a greater proportion of Hispanic 
students than Lutheran schools. In general, private 
schools enroll a higher proportion of White students 

than public schools, while 
public schools have a 
higher proportion of Black 
and Hispanic students. 
Private schools also enroll 
a smaller proportion of 
students with disabilities, 
English language learn- 
ers, and students eligible 
for free or reduced-price 
school lunch. 

Black and Hispanic fourth-graders in all private 
schools combined had higher average mathematics 
scores in 2003 than in 2000. However, no significant 
differences in scores were found across the same time 
period for Black and Hispanic private school students in 
grade 4 reading or grade 8 mathematics. 

A word of caution is needed: The data in this report 
provide a summary of the performance of students in 
public and private schools. The number of assessed 
students in some types of private schools is small, so it 
is not always feasible to make statistically meaningful 
comparisons between the performance of public school 
students and students in particular types of private 
schools. Factors not reported here, such as admission 
policies and parental involvement, can also influence 
student achievement. 




Students in Lutheran 
schools outperformed 
students in Conservative 
Christian schools in 
some instances in 
grades 4 and 8. 




Private schools 



generally enroll a 
smaller proportion of 
Black and Hispanic 
students than public 
schools. 
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Introduction 



► 

$ 

E- 



The NAEP website ( http://nces. 
ed.gov/nationsreportcard/ ) provides 
an array of information and results 
from the main NAEP assessments 
in 2000, 2002, 2003, and 2005, 
including PDF versions of all NAEP 
reports, a data tool for exploring the 
summary results and calculating 
statistical significance of differences, 
and a tool for examining released 
questions from the assessment. 

Subject-area frameworks for the 
NAEP assessments are available 
on the NAGB website ( http://www. 
nagb.org/pubs/pubs.html ). 



The National Assessment of 
Educational Progress (NAEP) measures 
the knowledge of students in grades 4, 
8, and 12 in a variety of subject areas. 
About 10 percent of the entire U.S. 
school population, almost 5.3 mil- 
lion students, attended private schools 
during the 2001-02 school year 
(Broughman and Pugh 2004). This 
report provides NAEP results for pri- 
vate schools in 2000, 2002, 2003, and 
some in 2005. The subjects addressed 
in this report are reading and writing at 
grades 4 and 8, and mathematics and 
science at grades 4, 8, and 12. 

What Information Is Available 
From NAEP About Private 
Schools? 

In the 1970s and 1980s, the NAEP 
long-term trend assessment reported 
data separately for public school 
students and for all private school stu- 
dents, without distinguishing among 
types of private schools. Beginning in 
1990, main NAEP also has reported 
performance data separately for private 
school students in Catholic and in 
non-Catholic schools. NAEP further 
increased the number of reporting 
categories for private schools for the 
2000 assessments to include Catholic, 
Lutheran, Conservative Christian, 
Other Religious, and Nonsectarian. 
Different reporting categories for pri- 



vate schools were used in 2002 and 
2003. In 2005, data were available only 
for Catholic and Lutheran schools. 
Table 1 shows the types of private 
schools for which NAEP collected 
reportable data in each subject and 
assessment year. 

What Findings Are Discussed 
in This Report? 

For the past 30 years, NAEP has 
reported that students in private schools 
outperform students in public schools. 
This report confirms that point, but 
also looks more closely at NAEP 
results for three types of private schools: 
Catholic, Lutheran, and Conservative 
Christian. Combined, these schools 
enroll the majority of private school 
students, and they participated in 
NAEP at most grades in 2000, 2002, 
and 2003. This is the first NAEP 
report to compare the performance of 
students in these three types of private 
schools. 

In this report, results of the 2000, 
2002, and 2003 NAEP assessments for 
Catholic, Lutheran, and Conservative 
Christian schools are compared with 
each other. Although all categories of 
private schools are included in the total 
for "overall" private, only these three 
categories are shown separately. An 
update on 2005 results for Catholic 
and Lutheran schools is also provided. 



Comparisons to public schools are 
also provided as points of reference. 
Results are given for students overall, 
as well as for student groups defined 
by race/ethnicity and — at grades 8 
and 12 only — by the highest level of 
education reached by the students 
parents. 1 Comparisons over time for 
the 2000-2003 mathematics and read- 
ing assessments are included whenever 
possible. Changes in the gaps between 
private and public school students 
performance are also discussed. The 
comparisons discussed in this report 
between students in the different 
types of private schools, and between 
students in private schools and pub- 
lic schools, are statistically significant 
unless otherwise stated. 



1 Eighth- and twelfth-grade students reported the highest level of education attained by either parent. Parental education data from fourth-graders are not reported because research 
indicates that these students are less likely to report data accurately. 



Table 1 . Grades assessed with reportable data, by subject and type of private school: Various years, 2000-2005 





Enrollment in private 
schools: Fall 2001 


Reading 


Mathematics 


Science 


Writing 


Type of school 


2000 


2002 


2003 


2005 


2000 


2003 


2005 


2000 


2002 


Catholic 


2,515,524 (4.7%) 


4 


4/8/* 


4/8 


4/8/ * 


4/8/12 


4/8 


4/8/* 


4/8/12 


4/8/ * 


Lutheran 


219,397 (0.4%) 


* 


4/8/* 


4/8 


4/8/* 


4/8/12 


4/8 


4/8/* 


4/8/12 


4/8/* 


Conservative Christian 


823,469 (1.6%) 


t 


4/t/t 


t/8 


*/*/* 


4/4/12 


1/8 


*/*/* 


4/8/ * 


4/t/t 


Other Religious 


882,009 (1.7%) 


t 


- 


- 


- 


4/*/* 


- 


- 


*/*/* 


- 


Nonsectarian 


901,114(1.7%) 


t 


- 


- 


- 


*/*/* 


- 


- 


*/*/* 


- 


Other Private 


- (-) 


- 


*/*/* 


-H- 

-H- 


*/*/* 


- 


+4- 

-H- 


*/*/* 


- 


*/*/* 



- Not available because data were not collected. 

$ Reporting standards not met. Data are not reported because participation rates failed to meet minimum NCES standards for reporting. 

NOTE: The grade in each cell indicates that reportable data for the category are available at this grade in this subject and year. Percentages of all students enrolled in each type of 
private school are shown in parentheses. Enrollment numbers are for elementary and secondary schools combined. 

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, Private School Universe Survey (PSS), 2001-2002, National 
Assessment of Educational Progress (NAEP), various years, 2000-2005 Reading, Mathematics, Science, and Writing Assessments. 
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Private School Types 

► Catholic schools included paro- 
chial, diocesan, and private 
order schools. 

► Lutheran schools included 
all those that indicated an 
affiliation with any branch of the 
Lutheran Church. 

► Conservative Christian schools 
included all those that indicated 
membership in Accelerated 
Christian Education, American 
Association of Christian Schools, 
Association of Christian Schools 
International, Association of 
Christian Teachers and Schools, 
or the Oral Roberts University 
Educational Fellowship. 

► Other Religious included all 
other schools that indicated 
an affiliation with any other 
religious organization. This 
category was tabulated 
separately only in 2000. 

► Nonsectarian schools included 
all private schools without 

an affiliation to any religious 
organization or institution. This 
category was tabulated sepa- 
rately only in 2000. 

► Other Private schools includ- 
ed the combined data for 
“Nonsectarian” and “Other 
Religious” schools, when data in 
those categories were too few to 
report separately. This category 
was created in 2002. 



How Are Results Reported? 

Results are reported in two ways: as 
average scale scores and as percentages 
of students attaining NAEP achieve- 
ment levels. Average scale scores in 
NAEP measure what students know 
and can do, and are reported on 
0—500 scales in mathematics and read- 
ing, with all three grades on the same 
scale; science and writing are reported 
on 0—300 scales with each of the three 
grades on a separate scale. 

Three achievement levels — Basic, 
Proficient, and Advanced — have been 
developed by the National Assessment 
Governing Board (NAGB) to provide 
a context for interpreting student per- 
formance on NAEP assessments. These 
achievement levels state what students 
should know and be able to do in each 
subject area and at each grade assessed. 
Further information on achievement 
levels and sample questions associ- 
ated with these achievement levels can 
be found in previous NAEP reports 
(see, for example, Braswell et al. 2005; 
Donahue, Daane, and Jin 2005) 
or online at http : / / nces . ed . gov/ 
nationsreportcard/ itemmaps/ or 
http://www.nagb.org/pubs/pubs.html . 

As provided by law, the National 
Center for Education Statistics 
(NCES), upon review of congressio- 
nally mandated evaluations of NAEP, 
has determined that achievement lev- 
els are to be used on a trial basis and 
should be interpreted and used with 
caution. However, NCES and NAGB 
have affirmed that these performance 
standards are useful for understanding 
trends in achievement. NAEP achieve- 
ment levels have been widely used by 
national and state officials for over a 
decade. 



Cautions in Interpretation 

It is important to note that a relationship 
between a variable and measures of educational 
achievement, like the ones presented in this 
report, does not imply that a difference in 
the variable causes differences in educational 
achievement. Higher performance scores in 
private schools do not imply that the private 
schools are better than public schools, as they 
often serve different populations of students. In 
addition, the results are cross-sectional, rather 
than longitudinal, so they only provide a snap- 
shot for any given point in time. Comparing 
students of a particular demographic group 
may provide more information; however, only 
one characteristic is compared at a time. For 
example, this report compares the performance 
of Black students in different types of schools, 
but it does not compare the performance of 
Black students who are eligible for free school 
lunch across school types, because of limita- 
tions of the sample. There are many reasons 
why the performance of one group of students 
differs from another, including factors that are 
not measured in NAEE 

Some key results are presented in the body 
of the report. Additional data for reading and 
mathematics are found in the Technical and 
Data Appendix. As indicated in the appen- 
dix tables, some of the data presented in the 
appendix should be interpreted with caution 
due to the uncertainty of the variability of the 
estimates. Also, estimates based on smaller 
student groups are likely to have relatively large 
standard errors. These large standard errors 
mean that some differences that seem large 
may not be statistically significant. Because 
private school results are based on smaller 
samples, they are less likely to show significant 
differences than the results from public schools. 
Standard errors, as well as additional data on 
science and writing, can be found using the 
NAEP data tool at http:/ / nces.ed.gov/ nations 
reportcard/nde/ . Further explanation is pro- 
vided in the Technical and Data Appendix. 



What Are NAEP Achievement Levels? 

Achievement levels are performance standards set by the National Assessment Governing Board (NAGB) to help interpret 
student performance on NAEP. The three NAEP achievement levels, from lowest to highest, are 

Basic - denotes partial mastery of the knowledge and skills that are fundamental for proficient work at each grade. 
Proficient - represents solid academic performance. Students reaching this level have demonstrated competency over 
challenging subject matter. 

Advanced - signifies superior performance. 

Detailed descriptions of the NAEP achievement levels for each subject can be found on the NAGB website 
( http://www.nagb.org/pubs/pubs.html ). 
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Characteristics of Students in Private Schools 
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Comparison of the characteristics 
of students in different types of pri- 
vate schools can indicate the extent 
to which they are serving different 
student populations. Characteristics 
of public school students are also 
shown for comparison. The student 
groups highlighted here include 
those defined by students race/eth- 
nicity, by the level of their parents 
education, by their eligibility to 
receive free or reduced-price school 
lunch, and by whether they have 
been identified as having a disability 
or as English language learners. The 
figures on these pages display the 
data from the 2003 grade 8 reading 
assessment, and are representative 
of findings across the subjects and 
grades. For student demographics 
in other grades and subjects, see 
the data appendix and the NAEP 
data tool, http://nces.ed.gov/ 
nationsreportcard/ nde/ . 



Race/Ethnicity 

At all grades and in all subject 
assessments included in this report, 
private schools overall had a higher 
percentage of White students than 
public schools, and public schools 
had higher percentages of Black 
and Hispanic students than pri- 
vate schools. Within the different 
types of private schools, Lutheran 
schools generally enrolled a higher 
percentage of White students than 
Catholic schools, and Catholic 
schools enrolled a higher percent- 
age of Hispanic students than 
Lutheran schools. Figure 1 shows 
the racial/ethnic distributions for 
the 2003 grade 8 reading assess- 
ment. The racial/ethnic categories 
shown — White, Black, Hispanic, 
and Asian/Pacific Islander — are 
mutually exclusive. Pacific Islander 
includes Native Hawaiian, and 
Hispanic includes Latino. Race 



categories exclude Hispanic origin 
unless specified. Data for American 
Indian/Alaska Native students are 
included in the total but are not 
broken out separately due to small 
sample sizes. 

Parents’ Highest Level of 
Education 

When eighth-grade students were 
asked to report their parents highest 
level of education, a greater percent- 
age of students in private schools 
compared to public schools reported 
that at least one parent had gradu- 
ated from college. No statistically 
significant differences in the highest 
level of education reported for at 
least one parent were found for any 
school category among the three 
types of private schools. Figure 2 
provides data at grade 8 from the 
2003 reading assessment. 



Figure 1. Percentage distribution of students who participated in reading 
assessment by race/ ethnicity and type of school, grade 8: 2003 



Type of school 


Grade 8 

61 


17 15 4 


Public 






76 d 


9 d 9 d 5 


Private 


■ n 




72 m 


9 d 13 b 4 


Catholic 


■ H 




83 a ’ d 


8 d 5 a - d 2 d 


Lutheran 






77 d 


11 7 d 3 


Conservative 

Christian 


m\\ 






C 


1 10 20 30 40 50 60 

Percent 


70 80 90 100 



White Black Hispanic Asian/ 

Pacific Islander 



a Significantly different from Catholic schools. 
b Significantly different from Lutheran schools. 
d Significantly different from public schools. 

NOTE: At each grade, approximately 1 percent of public school students were classified as Ameri- 
can Indian/Alaska Native, while the proportion of students of the same race/ ethnicity in private 
schools rounds to zero. Results are not shown for students whose race/ ethnicity was "other." 

Data for Other Private schools are included in the overall Private data but not reported separately. 
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Edu- 
cation Statistics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment. 



Figure 2. Percentage distribution of students who 
participated in reading assessment, by 
student-reported parents’ highest level of 
education and type of school, grade 8: 2003 



Type of school 



Grade 8 




Percent 



Less than Graduated Some Graduated Unknown 
high school from education after from 
high school high school college 



d Significantly different from public schools. 

NOTE: Detail may not sum to totals because of rounding. Data for Other Private 
schools are included in the overall Private data but not reported separately. 
SOURCE: U.S. Department of Education, Institute of Education Sciences, 
National Center for Education Statistics, National Assessment of Educa- 
tional Progress (NAEP), 2003 Reading Assessment. 
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KEY FINDINGS 



► Private schools enrolled 
a higher percentage 

of White students and 
a lower percentage of 
Black and Hispanic 
students than public 
schools. 

► On average, Lutheran 
schools enrolled a higher 
percentage of White 
students than Catholic 
schools, and Catholic 
schools enrolled a higher 
percentage of Hispanic 
students than Lutheran 
schools. 

► For all the assessments 
discussed in this report, 
at each grade, students 
in all types of private 
schools scored higher 
on average than public 
school students. 



► Where differences 
existed at grades 4 and 
8, students in Lutheran 
schools generally out- 
performed those in 
Conservative Christian 
schools. 



Free and Reduced-Price 
School Lunch 

A students eligibility for free or 
reduced-price school lunch, which 
depends on family income, is often 
used as a proxy for a measure of 
socioeconomic status. In the 2003 
reading assessment, 6 percent 
of students in all private schools 
combined were reported as eligible 
for free or reduced-price lunch at 
grade 4, and 1 1 percent at grade 
8. Approximately 9 percent of 
fourth-graders in both Catholic and 
Lutheran schools were eligible. In 
contrast, public schools reported 
that 44 percent of their fourth- 
graders were eligible for free or 
reduced-price lunch. 



However, these data should be 
interpreted with caution because of 
the high percentages of students in 
private schools for whom informa- 
tion was not available. Information 
was not available for about half 
of the fourth-grade students in 
Catholic and Lutheran schools. As 
seen in figure 3, the percentages of 
private school students for whom 
lunch-eligibility information was 
not available are also high for grade 
8. In contrast, information was 
not available for only 6 percent of 
the eighth-grade students in public 
schools. As a result, this report does 
not present performance data by 
groups defined by eligibility for free 
and reduced-price school lunch. 



Figure 3. Percentage distribution of students in reading, by students’ 

eligibility for free/ reduced-price school lunch and type of school, 
grade 8: 2003 



Grade 8 



Type of school 




0 10 20 30 40 50 60 70 80 90 100 

Percent 



Eligible Not eligible Information 
not available 



a Significantly different from Catholic schools. 
b Significantly different from Lutheran schools. 
c Significantly different from Conservative Christian schools. 
d Significantly different from public schools. 

1 For Conservative Christian schools, the percentage of students who were eligible for free/ 
reduced-price lunch rounds to zero. This percentage is significantly different from the percentages 
in Catholic, Lutheran, and public schools. 

NOTE: Detail may not sum to totals because of rounding. Data for Other Private schools are included in 
the overall Private data but not reported separately. 

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education 
Statistics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment. 
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